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INFORMATION RECORDING AND REPRODUCING APPARATUS 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

5 [0001] The invention relates to an information recording and reproducing 

apparatus capable of recording sound information and stroke information and 
reproducing the sound information. 

2. Description of the Related Art 

[0002] There are related art apparatuses that continuously record and 
10 reproduce sounds and voices issued at a meeting, conventional apparatuses are capable 
of recording sounds and voices continuously, storing notes as handwritten data, and 
playing back corresponding recorded sounds and voices later by designating the 
handwritten data. 

[0003] For example, US Patent No. 5,818,436 corresponding to Japanese 
15 Laid-Open Patent Publication No. 6-343 146 discloses an apparatus that plays back 

sound synchronized with handwritten data for a fixed period of time by clicking on the 
handwritten data. 

[0004] However, such an apparatus is intended to record sounds and voices 
continuously for a long time, and cannot record a specific portion only of the sounds 
20 and voices for a predetermined short time. In the apparatus, recording is executed from 
the time when the telephone is off-hook to the time when the telephone, for example, is 
on-hook. Further, the apparatus cannot record a specific portion only of the sounds and 
voices for a predetermined short time. 

[0005] Japanese Laid-Open Patent Publications Nos. 7-13688, 7-73 192, and 
25 7-78052, disclose an example that an image of a timer command to start a recording is 
drawn on a sheet, the image is recognized, and the recording is started. Further, to end 
the recording, an image of a timer command is drawn on the sheet, and the image is 
recognized, then the recording is ended. 

[0006] However, according to such an example, a user has to draw the image 
30 of the timer command, having to keep a person on the other end of the telephone 
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waiting while drawing the image. In addition, the image is left on the sheet 
meaninglessly. 

SUMMARY OF THE INVENTION - 
[0007] The invention provides an information recording and reproducing 

5 apparatus that can start recording sound or voice easily without the need for leaving the 
image of the timer command on the sheet meaninglessly, and a storage medium where 
an information recording and reproducing program is stored. 

[0008] In an aspect of the invention, an information recording and 
reproducing apparatus comprising a recording mode selecting device that includes a 

10 recording position designating portion for designating a certain position on a 

predetermined area and a switch that outputs a recording start signal and a recording end 
signal of sound data by switching of the switch; a coordinate data detecting device that 
detects coordinate data of a position designated by the position designating portion; a 
designated coordinate data storing device that stores the coordinate data detected by the 

15 coordinate data detecting device as designated coordinate data; and a sound data storing 
device that starts recording the sound data in response to an output of the recording start 
signal, ends recording in response to an output of the recording end signal, and stores 
the designated coordinate data in association with the sound data. 

[0009] During a talk at a meeting or on the phone, for example, when a user 

20 designates a certain position on a predetermined area of an input board using the 
recording position designating portion of the recording mode selecting device and 
switches the switch of the recording mode selecting device, a recording start signal is 
outputted from the recording mode selecting device. When the recording start signal is 
detected by the coordinate data detecting device, coordinate data of a position 

25 designated by the recording position designating portion is detected by the coordinate 
data detecting device. The coordinate data detected in this manner is stored as 
designated coordinate data by the designated coordinate data storing device. On the 
other hand, when the recording start signal is detected, the sound data storing device 
starts recording the sound data. At this time, the designated coordinate data is 

30 associated with the sound data. When the user switches the switch of the recording 
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mode selecting device, a recording end signal is outputted from the recording mode 
selecting device. In response to an output of the recording end signal, the sound data 
storing device ends the recording. Therefore, the recording of the- sound data can be 
started and ended with a simple operation, and remaining of meaningless written 

5 information can be prevented. Further, as the designated coordinate data and the sound 
data are stored in association with each other, searching of the sound data after a long 
interval can be smoothly made. 

[0010] In another aspect of the invention, the information recording and 
reproducing apparatus may further comprise a written information inputting device that 

10 includes a input position designating portion for inputting written information by 

designating a certain position on a predetermined area, and a written information storing 
device that stores the coordinate data detected by the coordinate data detecting device as 
stroke data, and stores the stroke data and the sound data in association with each other 
via the designated coordinate data. 

15 [001 1] Recording of the sound data and the designated coordinate data is 

executed as described above. Suppose the user inputs written information by 
designating a position which is identical with or close to the position designated by the 
recording position designating portion of the recording status switching device, using 
the input position designating portion of the written information inputting device. 

20 Coordinate data of the position designated by the input position designating portion of 
the written information inputting device is detected by the coordinate data detecting 
device. The written information storing device stores the coordinate data detected by 
the coordinate data detecting device that is, designated coordinate data, as a written 
information unit, and stores the written information unit and the detected sound data in 

25 association with each other via the designated coordinate data. Therefore, recording of 
the sound data can be started and ended with a simple operation. As an input of the 
written information and an instruction of the recording start or end are individually 
executed, remaining of meaningless written information only for the recording start or 
end can be prevented. In addition, as the written information is inputted at a designated 

30 position to execute recording, the designated coordinate data can be recognized easily. 
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As a result, searching of the sound data after a long interval can be smoothly made. 

[001 2] In a further aspect of the invention, in the information recording and 
reproducing apparatus, the written information storing device stores a plurality of sets of 
the stroke data in association with the sound data via the designated coordinate data. 

5 The apparatus further comprises a playback mode selecting device that includes a 
playback position designating portion for designating a playback position in the input 
area and that outputs a playback start signal, and a sound data playback device that starts 
a playback of the sound data stored in the sound data storing device in association with 
one of the plurality of sets of stroke data via the designated coordinate data for a 

10 position designated by the playback position designating portion in response to an 

output of the playback start signal when the designated coordinate data is determined to 
be included in a range where the one of the plurality of sets of stroke data belongs, in 
the input area. 

[0013] As mentioned above, the sound data, the designated coordinate data, 
15 and the stroke data are inputted. If the user designates a position in a predetermined 
range where the stroke data belongs using the position designating portion of the 
playback mode selecting device, and a playback start signal is outputted from the 
playback mode selecting device, coordinate data of the position designated by the 
playback mode selecting device is detected by the coordinate data detecting device. The 
20 detected coordinate data is determined to be included in the predetermined range where 
the stroke data belongs. Searching of the sound data stored in association with the 
stroke data via the designated coordinate data is executed. Searched sound data is 
played back by the sound data playback device. Accordingly, the sound data stored as 
described above can be reliably and smoothly played back. 
25 [0014J In a further aspect of the invention, the written information inputting 

device uses one end of a pen-type member as the input position designating portion, the 
recording mode selecting device uses another end of the pen-type member as the 
recording position designating portion. Therefore, the stroke data is stored simply in 
such a manner as to write a letter using a pen. The recording mode selecting device uses 
30 another end of the pen-type member as the recording position designating portion. 
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Therefore, inputting a recording start signal of the sound data and designating a position 
to record the sound data are simply done in such a manner as to designate a letter using 
a pen. As a result, the recording start of the sound data can be instructed smoothly. 
Further, in various exemplary embodiments the written information inputting device 
5 and the recording mode selecting device are realized in one pen-type member, which 
leads to usability improvements and cost reductions, 

[001 5] In another aspect of the invention, the written information inputting 
device and the recording mode selecting device share one end of the pen-type member 
as a position designating portion. Therefore, the stroke data is stored simply in such a 
10 manner as to write a letter using a pen. In addition, inputting a recording start signal of 
the sound data and designating a position to record the sound data are simply done in 
such a manner as to designate a letter using a pen. Further, as the written information 
inputting device and the recording mode selecting device are switched selectively via a 
switching device, the usability can be further improved. As a result, the recording start 
15 of the sound data can be instructed smoothly. In addition, the written information 
inputting device and the recording mode selecting device are realized in one pen-type 
member, which leads to cost reductions. 

[001 6] In a further preferred aspect of the invention, the written information 
inputting device and the recording mode selecting device individually use one end of 
20 respective pen-type members as a position designating device. Therefore, the stroke 
data is stored simply in such a manner as to write a letter using a pen. In addition, 
inputting a recording start signal of the sound data and designating a position to record 
the sound data are simply done in such a manner as to designate a letter using a 
separatepen. As a result, the recording start of the sound data can be instructed 
25 smoothly. 

[001 7] In another aspect of the invention, when the recording position 
designating portion makes contact with or is away from a predetermined area, the switch 
of the recording mode selecting device is switched to on or off in accordance with the 
state of the recording position designating portion. Therefore, an instruction of the 
30 recording start or end can be simply executed. 
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RRTEF DESCRIPTION OF THE DRAWINGS 
[001 8] The invention will be described in greater detail with reference to 
exemplary embodiments thereof and the accompanying drawings wherein; 

FIG. 1 is a perspective view showing a rough structure of an information 
5 recording and reproducing apparatus in a first exemplary embodiment of the invention; 
FIG. 2 is a block diagram of a marker in the information recording and 
reproducing apparatus of FIG. 1; 

FIG. 3 is a block diagram of an input board in the information recording and 
reproducing apparatus of FIG. 1; 
10 FIG. 4 is a flowchart for recording in the information recording and 

reproducing apparatus of FIG. 1; 

FIG. 5 A is an exemplary structure of sound data storage area in the information 
recording and reproducing apparatus of FIG. 1; 

FIG. 5B illustrates a coordinate point where the start of recording is issued; 
1 5 FIG. 5 C is an exemplary structure of a table 600; 

FIG. 6A illustrates handwritten data input in the information recording and 
reproducing apparatus of FIG. 1; 

FIG. 6B is an exemplary structure of sound data storage area; 
FIG. 6C illustrates a positional relationship between the handwritten data and 
20 coordinate data where the start of recording is issued; 

FIG. 6D is another exemplary structure of the address table 600; 
FIG. 6E is another exemplary structure of the address table 600; 
FIG. 7 A is a side view showing an indication of playback in the information 
recording and reproducing apparatus of FIG. 1; 
25 FIG. 7B is a plan view of FIG. 7 A; 

FIG. 8 illustrates an exemplary playback process in the information recording 
and reproducing apparatus of FIG. 1; and 

FIG. 9 is a flowchart of an exemplary erasing process in a second exemplary 
embodiment of the invention. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0019] One exemplary embodiment of the invention will be described in 
detail with reference to the accompanying drawings. 

[0020] As shown in FIG. 1 , an information recording and reproducing 
5 apparatus 100 includes a marker 101 A, a marker 101B (as will be further discussed 
below), and an input board 102. The marker 101A and the marker 101B in various 
exemplary embodiments, are discrete parts, but indicated as one part in FIG. 1 with their 
respective numerals. 

[0021] The input board 102 is formed in a board as shown in FIG. 1. A 
10 recording sheet 103 is placed on the surface of the input board 102. In various 

exemplary embodiments, the recording sheet 103 includes an easy-peel-off adhesive on 
the back of the recording sheet 103. The recording sheet 103 is affixed to the surface of 
the input board 102 with sufficient adhesion. In other various exemplary embodiments, 
a regular paper is fixed to the surface of the input board 102 by a fixing device, not 
15 shown. 

[0022] A tip 204 of the marker 101A (101B) outputs a signal, which the 
frequency is modulated to a predetermined value. The input board 102 functions as a 
magnetic coupling tablet. Thus, when a user taps the tip 204 of the marker 101 A 
( 1 0 1 B) on the recording sheet 1 03 , coordinate data of a position designated by the tip 
20 204 is stored by the magnetic coupling tablet. 

[0023] The tip 204 of the marker 101B can be used to write on the regular 
paper as well as other writing tools such as a pencil, a mechanical pencil, a ball-point 
pen, and a felt pen. Therefore, letters and marks can be written on the recording sheet 
103 using the tip 204. 

25 [0024] Further, the marker 101 A is provided with a playback/recording 

switch 205. The marker 101A functions in a playback mode or a recording mode by 
switching of the playback/recording switch 205. In other various exemplary 
embodiments, the playback/recording switch 205 is disposed on the input board 102, 
instead of the marker 101 A. 

30 [0025] FIG. 2 shows a structure of the marker 101A(101B). The marker 
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101 A is used to indicate the start and end of a recording, or to indicate the start and end 
of a playback. The marker 10 IB is used to input stroke data, which makes up 
handwritten data. Because the fundamental structure of the marker 101 A is common to 
the marker 101B, the structure is described with reference to one drawing. 

5 [0026] As shown in FIG. 2, each of the markers 101 A and 10 IB includes a 

signal switch 201, a signal transmitting unit 203, and a marker ID storing unit 202. 

[0027] The signal switch 201 is structured to work with the tip 204 of the 
marker 101A or 101B. As the tip 204 is moved vertically with minute strokes according 
to the pressure where the marker is pressed, the switch 201 is switched to on or off. In 

10 various exemplary embodiments, the switch 201 is set to on when the tip 204 is pressed 
against the recording sheet 103, and off when released. 

[0028] The marker ID storing unit 202 is composed of a memory, and stores 
ID information of the marker 101 A and the marker 101B respectively. The marker ID 
storing unit 202 of the marker 101 A stores ID information when the marker 101 A is in 

15 the recording mode and ID information when the marker 101 A is in the playback mode, 
separately from each other. In various exemplary embodiments, only one marker 10 IB 
is provided for inputting handwritten data. However, other exemplary embodiments 
include a plurality of different color markers so that they each can store different ID 
information. In this case, if color information data is stored with coordinate data, the 

20 color information data can be reflected in printing and displaying. 

[0029] In both markers 101 A and 101B, when the signal switch 201 is 
turned on, the signal transmitting unit 203 outputs a frequency-modulated signal, a 
phase-modulated signal, and/or an amplitude-modulated signal via the tip 204. The 
frequency, duty, or amplitude of the modulated signals is set differently according to the 

25 ID information. The modulation is controlled by a microcontroller, not shown, in 

accordance with the ID information coded and stored in the memory. Instead of storing 
the ID information into the memory, a modulation circuit that outputs a signal 
corresponding to the ID information may be provided in each of the marker 101A and 
the marker 1 01B in advance, so that the modulation can take place in response to the ID 

30 information. That is, based on the ID information of a mode selected by the switching 
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of the playback/recording switch 205, the marker 101A performs the modulation and 

outputs a signal corresponding to the selected mode. 

[0030] FIG. 3 is a block diagram of the input board 102. As shown in FIG. 

3, the input board 102 includes a marker signal detecting unit 301, a marker position 
5 detecting unit 302, a handwritten data storing unit 303, a marker ID detecting unit 304, a 

recording unit 306, a recording control unit 307, a sound storing unit 308, a reproducing 

unit 309, and a sound erasing unit 310. 

[0031] The marker signal detecting unit 301 includes a magnetic coupling 

tablet, and is made up of magnetic coupling elements disposed in a matrix under the 
10 surface where the recording sheet 103 is placed. When each magnetic coupling element 

detects a signal issued from the marker 101A or 101B, the electromagnetic property of 

the element varies, which is captured as a change in output. The detection of the signal 

may be performed at a fixed cycle or continuously for a certain period. Because the 

marker signal detecting unit 301 is made of magnetic coupling events, it can reliably 
1 5 receive output signals of the marker 1 0 1 A or 1 0 IB via the electromagnet elements even 

when the recording sheet 103 is placed on the surface of the marker signal detecting unit 

301. 

[0032] The marker position detecting unit 302 includes a tablet driver, and 
detects the change of the output of the magnetic coupling element as coordinate data. 
20 [0033] The marker ID detecting unit 304 includes a CPU, and detects ID 

information included in an output signal of the marker 101A or 101B. Based on the 
detection result, the marker ID detecting unit 304 determines which marker is currently 
being used. 

[0034] Fundamental structures of the marker 101 A, the marker 101B, the 
25 marker signal detecting unit 301 , the marker position detecting unit 302, and the marker 
ID detecting unit 304 are realized in similar structures disclosed in U.S. Patent No. 
5,136,125, and commonly owned U.S. Patent Application Nos. 09/636,818, 09/636,892, 
09/659,754, 09/628,724, 09/634,322, the disclosures of which are herein incorporated 
by reference. 

30 [0035] The handwritten data storing unit 303 includes a CPU and a memory. 
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When the ID information detected by the marker ID detecting unit 304 is the ID 
information included in an output signal of the marker 1 0 1 A in the recording mode, the 
coordinate data detected by the marker position detecting unit 302 is stored as 
designated coordinate data in the memory. When the ID information detected by the 
5 marker ID detecting unit 304 is the ID information included in an output signal of the 
marker 101B, the coordinate data detected by the marker position detecting unit 302 is 
stored as stroke data in the memory. A trail of the marker 101B made by the user 
manually drawing on the recording sheet 103 is stored as stroke data, which is data that 
is a group of coordinate data, in the memory. A collection of the stroke data makes up a 
10 string. 

[0036] Thus, the string is not limited to stroke data, which is obtained from a 
one-stroke input. For example, when "telephone number of Mr. A" is written on the 
recording sheet 103 as shown in FIG. 7B, a collection of stroke data corresponding to a 
trail of each letter of the "telephone number of Mr. A" is regarded as one string. In 

15 other words, a collection of stroke data is treated as one string until the amount of the 
change in either one of the detected coordinate data or the detected time is beyond a 
predetermined amount. If the predetermined amount is exceeded, the next collection of 
stroke data is treated as another string. There may be cases where the predetermined 
amount is exceeded but the coordinate data is not effective because a detection time of 

20 an output signal for the coordinate data that makes up new stroke data is too short. In 
such cases, the coordinate data may not be stored as new stroke data. In various 
exemplary embodiments, a string constructed as mentioned above is stored as the 
handwritten data. 

[0037] The recording unit 306 includes a CPU, an A/D converter, and a 
25 compression converter. The recording unit 306 converts sound signals, which are 
inputted via a microphone (not shown) provided in the input body 102, into digital 
signals, performs data compression in a predetermined format, and controls the writing 
of sound data into a memory. 

[0038] The sound storing unit 308 includes a memory, and stores sound data 
30 and time data which are outputted from the recording unit 306. 
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[0039] The recording control unit 307 includes a CPU, and indicates the start 
and the end of a recording process to the recording unit 306 according to the instruction 
of the marker 101 A in the recording mode. According to the instruction of the marker 
101A in the playback mode, the recording control unit 307 controls searching of the 
5 sound data, the start of a playback, and the end of the playback. 

[0040] The reproducing unit 309 includes a D/A converter and a 
decompression converter, and reproduces sound data stored in the sound storing unit 
308 based on the control by the recording control unit 307. 

[0041 ] The sound erasing unit 3 1 0 includes a CPU, and erases sound data 

1 0 from the memory when the marker 1 0 1 A by being switched to the recording mode with 
the playback/recording switch 205, is used in the erase mode. The marker 101 A is 
provided with a selective switch, not shown, that allows switching between the input 
mode and the erase mode. The marker ID storing unit 202 stores the ED information of 
the input mode and the ID information of the erase mode in advance. Based on the ID 

1 5 information of a mode selected by the switching of the selective switch, the marker 

101 A performs the modulation and outputs a signal corresponding to the selected mode, 
i.e., input or erase. In other various exemplary embodiments, the the selective switch is 
disposed on the input board 102, rather than the marker 101 A So as to facilitate the 
setting of the erase mode, the user may designate an area predetermined for the erase 

20 mode on the tablet using the marker 101 A. Further, the marker 101 A may be provided 
with a sensor that self-recognizes its posture, so that the marker 101 A is in the input 
mode when the marker 101 A is in a normal position and in the erase mode when the 
marker 101A is placed upside down. In various other exemplary embodiments, an 
eraser or a portion equivalent to the eraser may be provided at the rear end opposite to 

25 the tip 204 of the marker 101A, so that the marker 101A is in the erase mode when input 
is done using the eraser or the portion equivalent to the eraser. In this case, the eraser or 
the portion equivalent to the eraser includes a switch that is similar to the switch 201 
that is activated when the eraser or the portion equivalent to the eraser is pressed against 
the recording sheet 103. Various exemplary embodiments include a marker that is used 

30 only in the erase mode. 
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[0042] In other various exemplary embodiments, the above-mentioned units 
of the input board 102 do not necessarily have their own respective CPUs and 
memories. The input board 102 can be structured so that the above-mentioned units are 
controlled by one CPU and stored in one memory. 
5 [0043] A process/method where the sound data is stored will be described 

with reference to FIGS. 4 and 5. 

[0044] The method begins at step S4 1 , wherein it is determined whether the 
recording indication signal is on. When the user switches the playback/recording switch 
205 to the recording mode, the marker 101 A and the input board 102 are put in the input 

10 mode. When the tip 204 of the marker 101A is pressed against the recording sheet 103, 
the signal switch 201 is turned on, and the signal transmitting unit 203 outputs a signal. 
When the signal is detected by the marker signal detecting unit 301 of the input board 
102 and the ID information of the marker 101 A in the recording mode is detected by the 
marker ID detecting unit 304, the recording control unit 307 determines that a recording 

15 indication signal is on and issues an instruction of the start of the recording to the 

recording unit 306 and a recording process is started at step S42. Otherwise the method 
loops back to step S41 and continues to determirie if the signal is on. 

[0045] The sound data is stored in a designated storage area by the control of 
the recording unit 306. In various exemplary embodiments, the sound data may be 

20 sampled at a fixed sampling rate, and stored at a fixed transfer rate in a memory divided 
by a fixed memory capacity. 

[0046] FIG. 5A illustrates a structure of a sound data storage area 400, 
which is provided in the sound storing unit 308. The storage area 400 includes an 
attribute data location 401, a sound data location 402, and an end data location 403. The 

25 example of FIG. 5 A shows a structure of the storage area 400 for one type of sound 
data. Other types of sound data are stored in a similar structure. 

[0047] In the attribute data location 401, attribute data is stored. The 
attribute data describes whether the sound data was stored in the input mode or the 
erase mode. When the attribute data indicates that the data was stroed in the erase 

30 mode, the sound data location 402 can be used again as a storable area. 
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[0048] In the sound data location 402, the sound data that has been digitized 
and compressed by the recording unit 306 is stored. 

[0049] In the end data location 403, end data is stored when the storing of 
the sound data is finished. When the sound data location 402 includes available areas in 
5 a discontinuous state, address data indicating a next sound data location 402 may be 
stored in the end data location 403. In such a structure, the sound data location 402 can 
be put to the best possible use even if it is used with discontinuous address data as a 
result of an erasing process. 

[0050] In the storage area 400, the sound data is stored by the control of the 
1 0 recording unit 306. 

[0051] The recording control unit 307 performs the storing of the sound data 
as mentioned above, detects the coordinate data by the marker position detecting unit 
302 when the output signal of the marker 101 A is detected by the marker signal 
detecting unit 301, and stores the detected coordinate data as the designated coordinate 
15 data. For example, as shown in FIG. 5C, the designated coordinate data is stored in a 
pointer 404 provided in the sound storing unit 308. This process is also included in step 
S42, shown in FIG. 4. 

[0052] As shown in FIG. 5B, assume that a point P on the tablet (coordinate 
data: (n3, m3)) is indicated by the marker 101 A. In this case, the designated coordinate 
20 data (n3, m.3) is stored in the pointer 404 as shown in FIG. 5C. 

[0053] The recording control unit 307 stores a first address Adrl of the 
sound data storage area 400 in an area of an address table 600, which is associated with 
the coordinates the pointer 404 indicates. For example, the address table 600 of FIG. 
5C is provided in the sound storing unit 308. 
25 [0054] The table 600 includes an address location 601 indicating addresses 

in a handwritten data storage area 410 (see FIG. 6B) and an address location 602 
indicating addresses in the sound data storage area 400. Each of the address locations 
601, 602 has a plurality of storage areas, each of which corresponds to each of the 
coordinates that can be designated on the tablet. 
30 [0055] Therefore, in FIG. 5C, the first address Adrl of the sound data stored 
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in the storage area is stored in an area of the address location 602, which is associated 
with the coordinate data (n3, m3) the pointer 404 stores. In a blank area of the address 
table 600 of FIG. 5C, data except for effective address data, such as 00, is stored. 

[0056] As mentioned above, the designated coordinate data and the sound 
data to be stored are associated with each other. The process is also included in the 
recording start process of step S42 shown in FIG. 4. 

[0057] After the recording process is started, the method proceeds to step 
S43 as shown in Fig. 4, wherein it is determined whether the recording indication signal 
is off. When the user releases the marker 101 A from the recording sheet 103, the signal 
switch 201 is turned off and the signal transmitting unit 203 outputs a signal indicating 
the end of the recording. 

[0058] When the signal is detected by the marker signal detecting unit 301 
of the input board 102 and the ID information of the marker 101 A, which is switched to 
the recording mode, is detected by the marker ID detecting unit 304, the recording 
control unit 307 determines that the recording indication signal is off. The recording 
control unit 307 issues to the recording unit 306 an instruction to end recording, and the 
recording end process is performed at step S44. Otherwise, the method returns to step 
S43. 

[0059] Specifically, the output of the sound data from the recording unit 306 
to the storage area 400 is stopped, and the end data is stored in the end data location 403 
of the storage area 400. 

[0060] At step S45, an input process of the handwritten data is performed. 
The handwritten data input process is described with reference to FIGS. 4 and 6. 

[0061] The input process is started when the user uses the marker 101B 
instead of the marker 101 A and inputs the information representing letters or symbols 
on the recording sheet 103 as shown in FIG. 6 A. 

[0062] In other words, when the user starts writing handwritten data by 
pressing and moving the marker 101B against the recording sheet 103 as shown in FIG. 
6 A, the tip 204 of the marker 10 IB is pressed, the switch 201 is turned on, and the 
signal transmitting unit 203 outputs a signal. When the signal is detected by the marker 
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signal detecting unit 301 of the input board 102 and the ID information of the marker 
101B is detected by the marker ID detecting unit 304, the handwritten data storing unit 
303 stores the coordinated data found by the marker position detecting unit 302 in the 
memory. 

[0063] FIG. 6B illustrates a structure of a handwritten data storage area 410. 
The storage area 410 includes an attribute data location 41 1, a coordinate data location 
412, and an end data location 413. 

[0064] In the attribute data location 411, attribute data is stored. The 
attribute data describes an attribute of a past event related to the data. For example, the 
attribute data may indicate that the stored coordinate data was stored during an input 
mode or an erase mode. 

[0065] In the coordinate data location 412, stored is the coordinate data of 
the tip 204 of the marker 101B sampled every At seconds by the marker position 
detecting unit 302. Assuming that, as shown in FIG. 6A, the coordinate data at time T 
is (xO, yO), the coordinate data at time T + At is (xl, yl), and the coordinate data at time 
T + nAt is (xn, yn). The x coordinate data and the y coordinate data are stored in the 
order as shown in FIG. 6B. 

[0066] In the end data location 413, end data is stored. The end data 
indicates the end of a series of coordinate data. Therefore, a group of coordinate data 
that is delimited with the end data is recognized as a group of coordinate data that 
makes up the handwritten data of a string. A value that does not exist as the coordinate 
data is used for the end data. For example, a value greater than the maximum value of 
the coordinates or less than the minimum value of the coordinates is used. 

[0067] When the handwritten data of a string, which has already been 
inputted on the recording sheet 103, is deleted, the handwritten data is overwritten in the 
erase mode. As is the case with the marker 101 A, the marker 101B is also provided 
with a selective switch that allows switching between the input mode and the erase 
mode. Switching to the erase mode is made via the switch. In other various exemplary 
embodiments, the tablet may include the switch for switching between modes for the 
marker 101B. To facilitate the setting of the erase mode, the user may designate an area 
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predetermined for the erase mode on the tablet using the marker 101B. Further, the 
marker 101B may be provided with a sensor that self-recognizes its posture, so that the 
marker 1 01 B is in the input mode when the marker 101 B is in a normal position and in 
the erase mode when the marker 10 IB is placed upside down. An eraser or a portion 
5 equivalent to the eraser may be provided at the rear end opposite to the tip 204 of the 
marker 101 B, so that the marker 10 IB is in the erase mode when there is input using the 
eraser or the portion equivalent to the eraser. In this case, the eraser or the portion 
equivalent to the eraser includes a switch that is similar to the switch 201 that is 
activated when the eraser or the portion equivalent to the eraser is pressed against the 

10 recording sheet 103. Various exemplary embodiments include a marker that is only 
used in the erase mode. 

[0068] When an input is made in the erase mode, data indicating an attribute 
of deletion is stored in the attribute data location 41 1. For example, in various 
exemplary embodiments, a "0" is stored in the attribute data location 41 1 to indicate that 

15 the data was entered using a normal input mode, and a "1" is stored in the attribute data 
location 41 1 to indicate a data attribute of an erase mode input. 

[0069] A determination as to whether an input is completed is based on a 
new input within a certain period of time, an indication by the marker 10 IB at a 
predetermined area on the tablet, or switching of the switch provided in the marker 

20 101B. When the completion of the input is recognized, the end data is stored in the end 
data location 413. 

[0070] When the input is completed as mentioned above, the handwritten 
data storing unit 303 stores a first address of the handwritten data storage area 410 in an 
address location 601 of the address table 600. 
25 [0071] In FIG. 6C, the handwritten data W includes coordinate data (nl , 

m2), (nl, m3), (n2, m3), and (n3, m2). Thus, as shown in FIG. 6D, Adr2, which is a 
first address of the handwritten data storage area 410, is stored in areas corresponding to 
the coordinate data of the handwritten data W, in the address location 601 of the address 
table 600. 

30 [0072] The handwritten data storing unit 303 determines a positional 



17 



relationship between the handwritten data and the designated coordinate data based on 
the coordinates, and calculates an effective range as an designated area for a playback. 
For example, a point of the designated coordinate data is assumed to be at a center. 
Relative to the center, four coordinate points are calculated, each being the greatest in 
5 each of the positive and negative directions of the x-axis and the y-axis of the 

handwritten data. The four coordinate points define a rectangular area. The rectangular 
area is regarded as the designated area for the playback. 

[0073] In FIG. 6C, the designated coordinate data P (n3, m3) is the center, 
and in the handwritten data W, the coordinate data of (nl, m3) is the greatest in the 
10 negative direction of the x-axis, and (n3, m2) is the greatest in the positive direction of 
the y-axis. In this case, a rectangular area defined with the coordinate data (nl , m2), 
(nl, m3), (n3, m2), and (n3, m3) can be set as the designated area. In this exemplary 
embodiment, to facilitate the setting of desired handwritten data even if the designated 
position is deviated to some degree, a rectangular area, which is the diagonally shaded 
15 areas in FIG. 6C defined by coordinate data (nl, ml), (nl, m4), (nl, m4), and (n4, ml), 
is regarded as the designated area for the playback. 

[0074] The handwritten data storing unit 303 updates the contents of the 
handwritten data address location 601 in accordance with the designated area 
established as mentioned above. In the above example, to associate all of coordinate 
20 data included in the designated area indicated with the oblique lines in FIG. 6C, the first 
address Adr2 is copied as shown in FIG. 6E. 

[0075] Similarly, the handwritten data storing unit 303 updates the contents 
of the sound data address location 602 in accordance with all coordinate data included in 
the designated area. In the above example, to associate all of coordinate data included 
25 in the designated area indicated with the oblique lines in FIG. 6C, the first address Adrl 
is copied as shown in FIG. 6E. 

[0076] As mentioned above, the handwritten data input process includes the 
storing of the handwritten data and the creation of the address table 600. After step S45, 
the method stops as shown in FIG. 4. 
30 [0077] At a stage where the aforementioned processes are completed, there 
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may be written information such as "telephone number of Mr. A" on the recording sheet 
103 as shown in FIG. 7B, and the handwritten data associated with the written 
information is stored in the memory. The sound data is stored in the memory during the 
period where the user presses the marker 101 A on the recording sheet 103. 

5 [0078] For example, after a telephone is on-hook, the user sets the marker 

101A to the playback mode via the playback/recording switch 205, and selects a 
position within a designated area 500 using the marker 101 A as shown in FIGS. 7(A) 
and 7(B). Under this condition, the sound data can be played back. 

[0079] In other words, when the user presses the marker 1 01 A in the 

10 playback mode as shown in FIGS. 7(A) and 7(B) against a certain position within the 
designated area 500, the tip 204 of the marker 101A is pressed, the switch 201 is turned 
on, and the signal transmitting unit 203 outputs a signal. When the signal is detected by 
the marker signal detecting unit 301 of the input board 102 and the ID information of 
the marker 101 A in the playback mode is detected by the marker ID detecting unit 304, 

15 the recording control unit 307 refers to the address table 600 based on the coordinate 
data detected by the marker position detecting unit 302 as shown in "FIG. 8. The 
recording control unit 307 obtains content of the address location 602 associated with 
the coordinate data, that is, an address of the sound data storage area 400. Further, the 
recording control unit 307 issues an instruction of playback start to the reproducing unit 

20 309 and outputs the obtained address of the sound data storage area 400. Thus, as 
shown in FIG. 8, sound data 700 is played back by the reproducing unit 309. 

[0080] In the example of FIG. 6, if the coordinates designated by the marker 
101 A in the playback mode are (n2, m2), content associated with the coordinates (n2, 
m2) is referred in the sound data address location 602 of the address table 600. The 

25 content is address Adrl as shown in FIG. 6E. As a result, as shown in FIG. 5 A, the 
sound data of the storage area 400 that is indicated by the address Adrl is referred and 
played back. 

[0081] As mentioned above, in various exemplary embodiments, the user 
can make a recording by designating a point on the input board 102 using the marker 
30 101 A. Therefore, the recording can be reliably made even when it is immediately 
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required. Furthermore, the recording period can be adjusted easily according to a length 
of time that the marker 101 A is pressed. No meaningless letters, characters, and 
symbols remain after the recording process, because pressing the marker 101A against 
the recording sheet 103 is all that is needed to start the recording process. After the 
5 recording, the written information that the user recognizes can be associated with the 
point where the marker 101 A is pressed. Therefore, recorded sound can be played back 
by designating the written information with the marker 101 A. Even when time passes 
long after a recording, the recording can be played back reliably regardless of the length 
of time elapsed after the recording. As the written information can be freely input, the 

10 contents of the recording can be described concretely, so that the user can remember the 
recorded contents later. 

[0082] Next, a second exemplary embodiment of the invention will be 
described with reference to the method shown in FIG. 9. Parts in common with the first 
exemplary embodiment are indicated with the same numerals, and their descriptions are 

15 omitted for clarity. 

[0083] This embodiment shows an example for erasing the handwritten data 
and the sound data. The method begins at step S51, wherein the process of erasing the 
handwritten data is activated. The marker 10 IB is provided with a selective switch that 
allows switching between the input mode and the erase mode. The marker ID storing 

20 unit 202 stores the ID information of the input mode and the ID information of the erase 
mode in advance. Based on the ID information of a mode selected by the switching of 
the selective switch, the marker 101B performs the modulation and outputs a signal 
corresponding to the selected mode. In other exemplary embodiments, the selective 
switch may be disposed in or on the input board 1 02 rather than the marker 1 0 1 B. To 

25 facilitate the setting of the erase mode, the user may designate an area predetermined for 
the erase mode on the tablet using the marker 10 IB. 

[0084] Suppose that the user uses the marker 1 0 IB in the erase mode and 
draws two lines or an x mark on some handwritten data already input on the recording 
sheet 103. The user can freely draw lines and marks. Whatever handwritten data the 

30 user inputs, when the marker 1 0 1 B in the erase mode is pressed anywhere in the 
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designated area 500, the tip 204 of the marker 101B is pressed, the switch 201 is turned 
on, and a signal is issued from the signal transmitting unit 203. When the signal is 
detected by the marker signal detecting unit 301 of the input board 102 and the ID 
information of the marker 101B in the erase mode is detected by the marker ID 
5 detecting unit 304, the sound erasing unit 3 1 0 refers to the address table 600 of FIG. 6 
based on the coordinate data detected by the marker position detecting unit 302. Then 
the sound erasing unit 310 obtains content of the address location 601, which is 
associated with the coordinate data, that is, an address of the handwritten data storage 
area 410. 

10 [0085] For example, if the handwritten data W of FIG. 6C is erased. The 

sound erasing unit 310 refers to the address location 601 of the address table 600, and 
obtains the address Adr2. 

[0086] At step S52 the sound erasing unit 310 determines whether the erase 
process is for erasing all of the handwritten data. The determination may be made based 

15 on a stroke length of the marker 1 0 1 B or by designating a predetermined area on the 
tablet for an erase all instruction. 

[0087] When erasing of all of the handwritten data is not selected, then the 
erasing of the sound data is not executed. In various exemplary embodiments, the 
apparatus of the invention is used for taking notes on the recording sheet 103, wherein 

20 an erasing process to erase the handwritten data cannot be executed. However, for 
example, when the apparatus of this invention is applied to a whiteboard or the like, 
there are cases that a process of printing written data may be performed. Therefore, in 
this case, the handwritten data may be erased when erasing all the handwritten data is 
not selected . 

25 [0088] If the handwritten data W of FIG. 6 (C) is inputted in a whiteboard- 

type information recording and reproducing apparatus and some of the data W is erased 
using the marker 101B of an eraser type, the data process is as follows. Based on the 
address Adr2 obtained, the storage area 410 of FIG. 6B is referred, and data associated 
with a position that the marker 10 IB erases and a stroke length thereof is erased from 

30 the coordinate data location 412. In this case, a value that is impossible as the 
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coordinate data may be stored. 

[0089] If in step S52 it is determined that erasing of all handwritten data is 
selected, then the method proceeds to step S53, wherein the sound data erasing process 
is activated. The sound erasing unit 310 refers to the address table 600 of FIG. 6 based 
on the coordinate data detected by the marker position detecting unit 302. Then, the 
sound erasing unit 310 obtains content of the address location 602, which is associated 
with the coordinate data, that is, an address of the sound data storage area 400. Further, 
the attribute data indicating that erasing process is executed is stored in the attribute data 
location 401 of the storage area 400 that the obtained address indicates. 

[0090] When all of the handwritten data W of FIG. 6C is erased, the sound 
erasing unit 310 refers to the address location 602 of the address table 600 shown in 
FIG. 6E, and obtains the address Adrl. As shown in FIG. 5A, the attribute data 
indicates that the erasing process has been executed and is stored in the attribute data 
location 401 that the address Adrl indicates. As a result, the sound data location 402 is 
handled as an area capable of storing new sound data, making effective use of the 
storage area. 

[0091 ] For the whiteboard-type application, if erasing of all handwritten data 
is selected, the attribute data that indicates the erasing process has been executed is 
further stored in the attribute data location 41 1 of the handwritten data storage area 410. 
In this way, the contents of the coordinate data location 412 are cleared, and the 
coordinate data location 412 is in a state where new handwritten data can be stored. 

[0092] Because it is easy to erase the handwritten data and the sound data, 
the storage areas can be used effectively. 

[0093] In the embodiments, the magnetic coupling tablet is used to detect the 
coordinate data. However, the invention is not limited to such a tablet. An ultrasonic 
tablet or a touch panel may be used. 

[0094] The embodiments describe an example of drawing strings on the 
recording sheet. However, the invention is not limited to such an arrangement. The 
invention may include a displaying unit such as a liquid crystal display on which strings 
can be drawn. 
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[0095] In the above embodiments, the marker for storing the handwritten 
data and the marker for indicating playback/recording of the sound data are separately 
provided. The invention is not limited to such an arrangement. The functions provided 
in both markers may be integrated into one marker. In this case, such a marker may be 

5 provided with a switch for switching the functions. Instead of the switch, the functions 
of one marker may be switched by designating a certain area on the tablet or the touch 
panel. An end of one marker may be used for storing the handwritten data and another 
end may be used for indicating playback/recording of the sound data. In this case, 
inputting the handwritten data can be simply done in such a manner to write a letter 

10 using a pen. When the playback mode is activated via a mode switching device, 
inputting a playback start signal of the sound data and designating a position to play 
back the sound data are simply done in such a manner as to designate a letter using a 
pen. Similarly, when the recording mode is activated via the mode switching device, 
inputting a recording start signal of the sound data and designating a position to record 

15 the sound data are simply done in such a manner as to designate a letter using a pen. As 
a result, the recording start and the playback start of the sound data can be smoothly 
instructed. In addition, integration of the markers into one marker can provide cost 
reductions. 

[0096] In the above embodiments, recording is started when the marker, in 
20 the recording mode, is pressed against the recording sheet and is finished when released. 
The invention is not limited to such an arrangement. The marker may be provided with 
an on-off switch that controls the recording operation. 

[0097] In the above embodiments, an address table is used to link data. The 
invention is not limited to such an arrangement. Other methods may be used. Even 
25 when such a table is used, various addressing may be available. For example, the 
address data does not have to be directly stored as mentioned above, but rather an 
address of the pointer indicating the position of the address data can be stored. 

[0098] It should be understood that the invention is not limited in its 
application to the details of structure and arrangement of parts illustrated in the 
30 accompanying drawings. The invention is capable of other embodiments and of being 
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practiced or performed in various ways without departing from the technical idea 
thereof, based on existing and well-known techniques among those skilled in the art. 



